-
-
Notifications
You must be signed in to change notification settings - Fork 11.3k
[Docs] reemove the incorrect enable_reasoning parameter
#27550
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: zxw <1020938856@qq.com>
|
Documentation preview: https://vllm--27550.org.readthedocs.build/en/27550/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request correctly removes the --enable_reasoning parameter from the documentation, as it is not a valid vLLM CLI argument. The change is accurate and improves the documentation.
While reviewing, I discovered a critical bug in the HunyuanA13BReasoningParser that prevents the enable_thinking: false feature from working as intended. The is_reasoning_end method does not correctly process prompt tokens, leading to incorrect behavior when reasoning is disabled via request parameters. I've added a comment with a suggested fix for this issue.
Also, a minor note: the pull request title has a typo ("reemove" instead of "remove").
Overall, the documentation change is good to merge, but I highly recommend addressing the identified bug to ensure the Hunyuan model's reasoning features work correctly.
chaunceyjiang
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
--enable_reasoning is deprecated.
ref #17452
DarkLight1337
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the cleanup
…ct#27550) Signed-off-by: zxw <1020938856@qq.com>
…ct#27550) Signed-off-by: zxw <1020938856@qq.com>
…ct#27550) Signed-off-by: zxw <1020938856@qq.com>
…ct#27550) Signed-off-by: zxw <1020938856@qq.com>
Purpose
vLLM does not have
enable_reasoningparameterTest Plan
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.